Good Codes Based on Very Sparse Matrices
نویسنده
چکیده
Unfortunately this paper contains two errors with respect to Gallager's work on low density parity check codes. We gained the impression from the literature that \the sparse parity check codes studied by Gallager are bad," but this is in fact not the case. We also had the impression that Gallager's decoding algorithm was the same as Meier and Staaelbach's, and that our use of belief propagation was a new innovation. However, Gallager in fact proposed and used the identical belief propagation algorithm in 1962. We became aware of these errors shortly before the IMA conference on Cryptography and Coding (December 1995). We established that Gallager's low density parity check codes share all thègoodness' properties of thèMN' codes presented in this paper, and that their empirical performance is superior, as described in our more recent papers.
منابع مشابه
Good Error-Correcting Codes Based On Very Sparse Matrices - Information Theory, IEEE Transactions on
We study two families of error-correcting codes defined in terms of very sparse matrices. “MN” (MacKay–Neal) codes are recently invented, and “Gallager codes” were first investigated in 1962, but appear to have been largely forgotten, in spite of their excellent properties. The decoding of both codes can be tackled with a practical sum-product algorithm. We prove that these codes are “very good...
متن کاملErrata for "Good error-correcting codes based on very sparse matrices"
We study two families of error-correcting codes defined in terms of very sparse matrices. “MN” (MacKay–Neal) codes are recently invented, and “Gallager codes” were first investigated in 1962, but appear to have been largely forgotten, in spite of their excellent properties. The decoding of both codes can be tackled with a practical sum-product algorithm. We prove that these codes are “very good...
متن کاملGood Error{correcting Codes Based on Very Sparse Matrices
We study two families of error-correcting codes deened in terms of very sparse matrices. `MN' (MacKay{Neal) codes are recently invented, and`Gallager codes' were rst investigated in 1962, but appear to have been largely forgotten, in spite of their excellent properties. The decoding of both codes can be tackled with a practical sum{product algorithm. We prove that these codes arèvery good', in ...
متن کاملLinear Transformations for Randomness Extraction
Information-efficient approaches for extracting randomness from imperfect sources have been extensively studied, but simpler and faster ones are required in the high-speed applications of random number generation. In this paper, we focus on linear constructions, namely, applying linear transformation for randomness extraction. We show that linear transformations based on sparse random matrices ...
متن کاملSparse graph codes for compression, sensing, and secrecy
Sparse graph codes were first introduced by Gallager over 40 years ago. Over the last two decades, such codes have been the subject of intense research, and capacityapproaching sparse graph codes with low complexity encoding and decoding algorithms have been designed for many channels. Motivated by the success of sparse graph codes for channel coding, we explore the use of sparse graph codes fo...
متن کاملCapacity Achieving Linear Codes with Random Binary Sparse Generating Matrices
In this paper, we prove the existence of capacity achieving linear codes with random binary sparse generating matrices. The results on the existence of capacity achieving linear codes in the literature are limited to the random binary codes with equal probability generating matrix elements and sparse parity-check matrices. Moreover, the codes with sparse generating matrices reported in the lite...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1995